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Tn the Claims 

Claims 46-51 are canceled without prejudice. 

Claims 1-5, 10, and 19-45 and 52-63 remain in the application for 
consideration and are listed below: 

1. (ORIGINAL) A facial expression transformation method 
comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

2. (ORIGINAL) The method of claim 1, wherein the training set of 
expressions contains fewer expressions than the code book. 

3. (ORIGINAL) The method of claim 1, wherein the transformation 
function compensates for differences in the size and shape of the faces of the first 
and second persons. 
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t 4, (ORIGINAL) The method of claim 1, wherein said deriving of the 

2 transformation function comprises computing a linear transformation from one set 

3 of expressions to another. 

5. (ORIGINAL) The method of claim 1, wherein the deriving of the 
6 1[ transformation function comprises: 

7 ,i representing each expression as a 3/M-vector that contains x, y, z 

8 1| displacements at m standard sample positions; and 

9 „ computing a set of linear predictors a,, one for each coordinate of g a , given 

a set of n expression vectors for a face to be transformed, g^..„, and a 
J corresponding set of vectors for a target face, g bl ... n , by solving 3* linear least 
12 squares systems of the following form: 
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6.-9. (CANCELED). 



10. (ORIGINAL) The method of claim 1, wherein said providing data 
i 8 1| defining a second set of facial expressions comprises: 

illuminating the second person's face with illumination; and 
contemporaneously capturing structure data describing the face's structure 
2 , 1 and reflectance data describing reflectance properties of the face from the 
22 I illumination. 
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19, (ORIGINAL) One or more computer-readable media having 
computer-readable instructions thereon which, when executed by a computer, 
cause the computer to: 

operate on a training set of expressions from one person and corresponding 
expressions from a code book of another person to compute a linear 
transformation function from the training set and their corresponding expressions; 
and 

apply the transformation function to a plurality of expressions from the 
code book to provide a synthetic set of expressions. 

20, (ORIGINAL) The computer-readable media of claim 19, wherein 
the instructions cause the computer to use the synthetic set of expressions to 
transform expressions from the one person into expressions of the other person. 

21, (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform expressions from the one person 
that are different from those expressions comprising the code book expressions. 

22- (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform expressions by transmitting at 
least one index of a synthetic expression to a receiver that can reconstruct the 
expression. 

23- (ORIGINAL) The computer-readable media of claim 20, wherein 
the instructions cause the computer to transform facial expressions. 
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24. (ORIGINAL) A facial expression transformation system 
comprising: 

a code book embodied on a computer-readable medium, the code book 
containing data defining a first set of facial expressions of a first person; 

data embodied on a computer-readable medium, the data defining a second 
set of facial expressions, the second set of facial expressions providing a training 
set of expressions of a second person who is different from the first person; and 

a transformation processor configured to derive a transformation function 
from the training set of expressions and corresponding expressions from the first 
set of expressions - 

25. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation processor comprises a linear transformation processor. 

26. (ORIGINAL) The expression transformation system of claim 24 
further comprising a synthetic set of expressions embodied on a computer- 
readable medium, the synthetic set of expressions being derived by applying the 
transformation function to the code book expressions. 

27. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation function compensates for differences in the size and 
shape of the faces of the first and second persons. 
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28. (ORIGINAL) The expression transformation system of claim 24, 
wherein the transformation processor derives the transformation function by: 

representing each expression as a 3m-vector that contains x, y, z 
displacements at m standard sample positions; and 

computing a set of linear predictors a,, one for each coordinate of*, given 
a set of n expression vectors for a face to be transformed, g oJ ..,, and a 

corresponding set of vectors for a target face, gbl by solving 3m linear least 

squares systems of the following form: 

29. (ORIGINAL) A facial expression transformation system 
!2 comprising: 

13 n a transmitter comprising: 

a fecial Ulurrnnation system that is configured to provide multiple affect 
J light sources at the same time for fliuminating a subjeefs face; 

a data-capturing system configured to capture both structure data and 
J reflectance date from the subject's face when illuminated by the facia, 
is illumination system; and 

19 „ a first code book of synthetic expressions that have been synthesized by: 

20 „ receiving a training set of expressions provided by the subject; 
computing a transformation function using the training set of expressions 

J and corresponding unsynthesized code book expressions; and 
* II applying the transformation function to all of the expressions in the code 

24 II book; and 

25 „ a receiver communicatively linked with the transmitter and comprising: 
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a reconstruction module for reconstructing facial images; and 
a second code book containing the same synthetic expressions as the first 

code book; and 

the transmitter being configured to: 
capture additional expressions of the subject; 

search the first code book for a corresponding or near matching expression; 

and 

transmit an index of a corresponding or matching code book expression to 
the receiver for facial image reconstruction by the reconstruction module. 

30. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises at least one polarized light source. 

31. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises multiple polarized light sources. 

32. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises a patterned light source configured to 
project a pattern onto the subject's face. 

33. (ORIGINAL) The expression transformation system of claim 29, 
wherein the illumination system comprises an infrared patterned light Source 
configured to project a pattern onto the subject's face. 
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34. (ORIGINAL) The expression transformation system of claim 29, 
wherein the different light sources are all infrared light sources* 

35. (ORIGINAL) A method of animating facial features comprising; 
defining a subdivision surface that approximates geometry of a plurality of 

different faces; and 

fitting the same subdivision surface to each of the plurality of faces. 

36. (ORIGINAL) The method of claim 35, wherein said defining 
comprises defining the subdivision surface with a coarse mesh structure. 

37. (ORIGINAL) The method of claim 36, wherein the coarse mesh 
structure comprises a triangular mesh. 

38. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises performing a continuous optimization operation over vertex positions of 
the subdivision surface. 

39. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises fitting the subdivision surface to the faces without altering the 
connectivity of a mesh that defines the subdivision surface. 

40. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises minimizing a smoothing functional associated with a mesh that defines 
the subdivision surface. 
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41. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises selecting one or more constraints associated with a mesh that defines 
the subdivision surface and fitting those constraints directly to corresponding 
points on the faces. 

42. (ORIGINAL) The method of claim 41, wherein the constraints are 
associated with one of the eyes, nose and mouth* 

43. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises minimizing a functional that includes terms for distance, smoothness, 
and constraints. 

44. (ORIGINAL) The method of claim 35, wherein said fitting 
comprises solving a sequence of linear least-squares problems. 

45. (ORIGINAL) One or more computer-readable media having 
computer-readable instructions thereon which, when executed by one or more 
computers, cause the one or more computers to implement the method of claim 35. 

46. -5L (CANCELED) 

52. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 
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defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions, wherein the deriving 
of the transformation function comprises: 

representing each expression as a 3m-vector that contains x, y ? z 

displacements at m standard sample positions; and 

computing a set of linear predictors a j9 one for each coordinate of g at 

given a set of n expression vectors for a face to be transformed, g a j Mm and a 

corresponding set of vectors for a target face, gM„ M9 by solving 3m linear 

least squares systems of the following form: 

aj •#» = £■*[/], » = 1. 
wherein said computing comprises using only a subset of points for 
each g a j; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

53* (PREVIOUSLY PRESENTED) The method of claim 52, wherein 
said using comprises using only points that share edges with a standard sample 
point under consideration. 
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54. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions, wherein the deriving 
of the transformation function comprises; 

representing each expression as a 37??-vector that contains x, y, z 

displacements at m standard sample positions; and 

computing a set of linear predictors a j9 one for each coordinate of g ay 

given a set of n expression vectors for a face to be transformed, g a j..,n, and a 

corresponding set of vectors for a target face, g w by solving 3m linear 

least squares systems of the following form: 

controlling the spread of singular values when computing a 
pseudoinverse to solve for the a/ 9 and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

55, (PREVIOUSLY PRESENTED) The method of claim 54, wherein 
said controlling the spread comprises zeroing out all singular values less than aa u 
where a } is the largest singular value of the matrix. 
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56. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person's face with illumination, said 
illuminating comprising: 

using multiple light sources, one of which projecting a pattern on the 
second person's face from which the structure data can be ascertained; 

at least one of the light sources comprising an infrared light source; 
at least one of the light sources being polarized; and 
contemporaneously capturing structure data describing the face's 
structure and reflectance data describing reflectance properties of the face 
from the illumination, said capturing comprising using a camera having a 
polarizer that suppresses specularly-reflected light so that diffuse 
component reflection data is captured; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 



12 



PAGE 14/18* RCVD AT 7/912004 12:48:01 PM [Eastern Daylight Timer SVR:USPT0-EFXRF-1/2 * DN1S:8729306* CSID:509 323 89/9* DURATION (mm-ss):0W0 



•JUL 09 2004 10=03 FR LEE - HAYES PLL 509 323 8979 TO 17038729306 P. 15/18 



I 

2 
3 
4 
5 
6 
7 
8 
9 
10 

u 

12 
13 
14 
IS 
16 
17 
IB 
19 
20 
21 
22 
23 

24 
25 



57, (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person's face with a first polarized light 
source that is selected so that specularly-suppressed reflective properties of 
the face can be ascertained; 

illuminating the second person's face with a second structured light 
source that projects a pattern onto the face, while simultaneously 
illuminating the face with the first polarized light source; and 

capturing both specularly-suppressed reflection data and structure 
data from the simultaneous illumination; 

deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

58. (PREVIOUSLY PRESENTED) The method of claim 57, wherein 
the light sources provide light at different frequencies. 
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59. (PREVIOUSLY PRESENTED) The method of claim 57 \ wherein 
the light sources provide infrared light. 
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60. (PREVIOUSLY PRESENTED) The method of claim 57, further 
comprising processing the captured data to provide both (a) data that describes 
dimensional aspects of the face and (b) data that describes diffuse reflective 
properties of the face. 

61. (PREVIOUSLY PRESENTED) A facial expression transformation 
method comprising: 

defining a code book containing data defining a first set of facial 
expressions of a first person; 

providing data defining a second set of facial expressions, the second set of 
facial expressions providing a training set of expressions of a second person who 
is different from the first person, wherein said providing data defining a second set 
of facial expressions comprises: 

illuminating the second person's face with multiple different light 

sources; 

measuring range map data from said illuminating; 
measuring image data from said illuminating; 
deriving a 3-dimensional surface from the range map data; 
computing surface normals to the 3-dimensional surface; and 
processing the surface normals and the image data to derive an 
albedo map; 
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deriving a transformation function from the training set of expressions and 
corresponding expressions from the first set of expressions; and 

applying the transformation function to the first set of expressions to 
provide a synthetic set of expressions. 

62. (PREVIOUSLY PRESENTED) The method of claim 61, wherein 
at least one of the light sources is polarized. 

63. (PREVIOUSLY PRESENTED) The method of claim 61, wherein 
all of the light sources are polarized. 
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